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Abstract. - We study the spectrum of the Hessian of the Sherrington-Kirkpatrick model near 
T = 0, whose eigenvalues are the masses of the bare propagators in the expansion around the 
mean-field solution. In the limit T <C 1 two regions can be identified. The first for x close to 0, 
where x is the Parisi replica symmetry breaking scheme parameter. In this region the spectrum 
of the Hessian is not trivial, and maintains the structure of the full replica symmetry breaking 
state found at higher temperatures. In the second region T<i<lasT^0, the bands typical 
of the full replica symmetry breaking state collapse and only two eigenvalues are found: a null 
one and a positive one. We argue that this region has a droplet-like behavior. In the limit T — > 
the width of the full replica symmetry breaking region shrinks to zero and only the droplet-like 
scenario survives. 
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The physics of spin glasses is still an active field of re- 
search because the methods and techniques developed to 
analyze the static and dynamic properties have found ap- 
plications in a variety of others fields of the complex sys- 
tem world, such as neural networks or combinatorial op- 
timization or glass physics. In the study of spin glasses a 
central role is played by the Sherrington-Kirkpatrick (SK) 
model PP, introduced in the middle of 70's, as a mean 
field model for spin glasses. Despite the fact that its so- 
lution, known as the "Parisi solution" [2j[3] , was found 30 
years ago, some aspect arc still far from being completely 
understood. In this Note we discuss the stability, that is 
the eigenvalue spectrum of the Hessian of the fluctuations, 
of the Parisi solution in the T « 1 and its implications 
for the Replica Symmetry Breaking (RSB) versus droplet 
scenarios. 

' Model.-The model is defined by the Hamiltonian [3] 



the thermodynamic limit can be written as function of the 
symmetric nxn site dependent replica overlap matrix Q® b 
as —J3f = lim n _> i\ maxQ C[Q] with [5] 
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where Sj = ±1 arc N Ising spins located on a regular d- 
dimcnsional lattice and the symmetric bonds Jij, which 
couple nearest-neighbor spins only, are random quenched 
Gaussian variables of zero mean. The variance is prop- 
erly normalized to ensure a well defined thermodynamic 
limit N — > oo. By using the standard replica method 
to average over the disorder, the free energy density / in 



where Q ab is the spatial Fourier Transform of Qf b and 
f3 = 1/T. The notation "(ab)" means that only dis- 
tinct ordered pairs a < b (a,b = l,...,n) are counted. 
By writing Qf b = Q ab + SQf and expanding C[Q] in 
powers of 5Qf b one generates the loop expansion. The 
site-independent Q ab is given by the mean field value 
Qab _ ( s a s b^ w here angular brackets denote a weighted 
average with exp(/3 2 J2( a b) Q ab s a s b ). This follows from the 
stationarity of C[Q], that is the vanishing of the linear 
term in the expansion, and ensures that no tadpoles are 
present. The quadratic term of the expansion defines the 
bare propagators whose "masses" are given by the eigen- 
values of the non-kinetic part of the fluctuation matrix: 
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P 2 \{s a s b s c s d ) - (s a s b )(s c s d )] (3) 



that is the Hessian matrix of the SK model. 

Stability of the Parisi solution for the SK model near its 
critical temperature T c , has been established long ago by 
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exhibiting the eigenvalues of the Hessian matrix [5J[7] . In 
few words, one has a Replicon band whose lowest masses 
are zero modes, and a Longitudinal- Anomalous band, sit- 
ting at (T c — T), of positive masses, both with a band 
width of order (T c — T) 2 . The analysis was extended via 
the derivation of Ward-Takahashi identities [5], showing 
that the zero Replicon modes would remain null in the 
whole low temperature phase, and hence would not ruin 
the stability under loop corrections to the mean field so- 
lution. 

Despite these efforts a complete analysis of the stability 
in the zero temperature limit is still missing. Near T c one 
can take advantage of the vanishing of the order parameter 
for T = T c and expand £[Q], a simplification clearly miss- 
ing close to zero temperature, where the order parameter 
stays finite. 

Low Temperature Phase.-As the temperature is low- 
ered the ergodicity breaks down at the critical temperature 
T c = 1. Below T c the phase of the SK model is character- 
ized by a large, yet not extensive, number of degenerate 
locally stable states in which the system freezes. The sym- 
metry under replica exchange is broken and the overlap 
Q ab becomes a non-trivial function of replica indexes. As- 
suming R steps of RSB the matrix Q ab is divided, follow- 
ing the Parisi parameterization [3], into successive boxes 
of decreasing size_p r , with po = n and Pr+i = 1, with 
elements given b}o 
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where r = a D b denotes the overlap between replicas a and 
b. This means that a and b belongs to the same box of 
size p r , but to two distinct boxes of size p r +i < Pr- The 
solution of the SK model is obtained by taking R — > oo. 
In absence of an external field the overlap Q ab takes values 
between zero and a maximum value q c (T) < 1, and so for 
R — > oo the matrix Q ab is described by a continuous non- 
decreasing function Q(x) parameterized by the variable x. 
In the Parisi scheme x € [0, 1] and gives the probability 
for a pair of states to have an overlap Q ab not larger than 
Q{x). 

The meaning of x depends on the parameterization used 
for the matrix Q ab . In the dynamical approach [5HTT] 
x labels the relaxation time scale t x , so that Q(x) = 
(s(t x ) s(0)). Here the angular brackets denotes time (and 
disorder) averaging. The smaller x the longer t x . All time 
scales diverges in the thermodynamic limit but t x i/t x — > 
oo if x > x'. To make contact with the static Parisi solu- 
tion one takes x G [0,1], with x = corresponding to the 
largest possible relaxation time and x = 1~ to the short- 
est one. With this assumption one recovers Q(0) = and 
Q(l~) = q c {T). In both cases Q(l) = 1, since it gives the 
self or equal-time overlap. Other choices are possible, e.g., 
those used in Refs. [T2"HT5] to handle the T -> limit. We 
stress however that different choices just give a different 
parameterization of the function Q(x), but do not change 
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Fig. 1: Shape of the order parameter function Q(x) for Tel 
in the Parisi parameterization. The shaded area shows the 
extent of the boundary layer of thickness 8 ~ T as T — > 0. 



the physics, since the relevant quantities are the possible 
values q that the function Q(x) can take and their prob- 
ability distribution P(q). This property is called gauge 
invariance [ MT2"lllT)] . In what follows we assume the Parisi 
parameterization. 

It turns out [TTJ [T5] that as the temperature is de- 
creased towards T = the probability of finding overlaps 
Q ab sensibly smaller than q c {T) = 0(1) vanishes with 
T, while there is a finite probability x c ~ 0.524 . . . that 
Q ab < q c (T). Thus, since Q(0) = 0, for T < 1 the order 
parameter function Q(x) in the Parisi parameterization 
develops a boundary layer of thickness S ~ T close to 
x — 0, as shown in Fig. [TJ From the Figure we see that 
for very small T the function Q(x) is slowly varying for 
S <C x < x c . However, in the boundary layer < x < 5, it 
undergoes an abrupt and rapid change. In the limit T — > 
the thickness S ~ T — > and the order parameter function 
becomes discontinuous at x = 0. 

This behavior of Q(x) for T < 1 has strong conse- 
quences since other relevant quantities, such as, e.g, the 
four-spin correlation entering into the Hessian matrix, can 
be computed from partial differential equations of the 
form, 



F(x,y) 



Q(x) 



F"{x, y) + 2f3xm(x, y)F'(x,y) , (5) 



1 For consistency one takes Q aa = 



= 1. 



that gives the function F(x,y) for x < x* once F(x*,y) 
is known. Details will be given elsewhere [TH]. As usual 
the "dot" and the "prime" denote derivative with respect 
to x and y, respectively. The function F(x,y) is a generic 
quantity at the scale x in presence of the frozen field y. 
The function m(x,y) is the local magnetization and it is 
itself solution of cq. with F(x, y) = m(x, y) and initial 
condition m(l,y) = tanh/3y [12j . In the limit T — > we 
then face a boundary layer problem. 

Uniform approximate solutions valid for T< 1 can be 
constructed by using the boundary layer theory, that is by 
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studying the problem separately inside (inner region) and 
outside (outer region) the boundary layer [5D]. One then 
introduces the notion of the inner and outer limit of the 
solution. The outer limit is obtained by choosing a fixed 
x outside the boundary layer, that is in 5 <C x < 1, and 
allowing T — > 0. Similarly the inner limit is obtained by 
taking T — > with x < 5. This limit is conveniently ex- 
pressed introducing an inner variable a, such as a = x/d, 
in terms of which the solution is slowly varying inside the 
boundary layer as T — > 0. The inner and outer solutions 
are then combined together by matching them in the in- 
termediate limit x — > 0, x/6 — > oo and T — > 0. 

The inner solution of Q(x) as T — > was first computed 
by Sommers and Dupont in their pioneering work |12j by 
using the inner variable a defined as \/ (dQ(a) / da) = x/T 
and T -+ 0, the so called Sommers-Dupont gauge. Re- 
cently the inner solution for the order parameter function 
Q(x) as T — > was extensively studied by Oppermann, 
Sherrington and Schmidt |13H15j by using as inner vari- 
able a = x/T, as suggested by the Parisi- Toulouse ansatz 
[2"T] . In both cases one finds that the inner solution Q(o) 
for T — > is a smooth function of a varying between 
and q c ~ 1. 

The outer solution was studied by Pankov [22], who 
found that in the outer region one has 



Q(x) ~ 1 - c(j3x)~ 



T < x < x c and T -+ (6) 



where c = 0.4108 . . .. The breakpoint x c is T-dependent, 
however its dependence is rather weak and x c (T) ~ 
x c (0) = 0.524 ... is a rather good approximation for T <C 1 
[18] . From this expression one sees that the variation of the 
Q(x) in the outer region [Q(x c ) — Q(x)]/Q(x) ~ c(T/x) 
is indeed rather weak. 

More interestingly in his work Pankov has found that 
for T < i < i c and T —> both the local magnetization 
m(x, y) and the distribution function P(x, y) of the frozen 
field y at scale x loose their explicit dependence on the 
scale variable x. This result can be extended to the so- 
lution of the generic partial differential equation ([5]). By 
using the same notation as Pankov this means that in the 
outer region the solution of cq. © is of the form 



F(x,y) = F(z), z = (3xy. 



(7) 



called scaling solution by Pankov. This insensitivity with 
respect to the scale will allow for a complete diagonaliza- 
tion of the Hessian matrix in the outer region. 

The Hessian Matrix.-With 4 replicas the Hessian J3]) 
is characterized by 3 overlaps. We can distinguish two 
cases. The Longitudinal-Anomalous (LA) geometry char- 
acterized by a n b — r, cfl d = s and, if r ^ s, the single 
cross overlap t = max[a PI c, a PI d, b PI c, b PI d]: 
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r,s,t = 0,l,...R. 



one has the two cross-overlaps u = max[a Pi c, a PI d] and 
v = max[6 Pi c, b PI dl with u, v > r + 1: 



M ab; 
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u, v > r + 1. 
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The Hessian is a "( n ~ 1 ) x "( n ~ 1 ) symmetric matrix that 
after block-diagonalization becomes a string of (R + 1) X 
(i? + 1) blocks along the diagonal for the LA Sector, fol- 
lowed by 1 x 1 fully diagonalized blocks, for the Replicon 
Sector H3H25]. 

Replicon Sector.-The diagonal elements in the Replicon 
Sector are given by the double Replica Fourier Transform 
(RFT) of M^f v with respect the cross-overlaps u, v [33] 
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u— k v—l 
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In the limit R 

and p r = x(Q r 



oo the sums are replaced by integrals 
To evaluate M T ~' r - we have to compute 

k\l 

the matrix elements M"Q r v , that is the four-spin average 
(s a s b s c s d ) for the Replicon geometry, by solving equa- 
tions of the form ([5]). If r lies in the outer region, that 
is p r — x(Q r ) 3> T as T — > or, equivalently, for fixed 
r ^ and T — > 0, then insensitivity with respect to the 
scale variable implies that is independent of k and I. 
Thus by exploiting this insensitivity we conclude that 



m: ; : = M!Z ~ = o ( -4 ) R = J 

k;l r+l;r+l \ R 2 



(11) 



The second equality follows from a Ward-Takahashi iden- 
tity [S]. In the inner region the Replicon spectrum main- 
tains its complexity. However its relevance becomes less 
and less important as T approaches zero, and vanishes 
in the limit T — > when the thickness of the boundary 
shrinks to zero. The Replicon spectrum, similarly to the 
order parameter function Q(x), becomes then discontinu- 
ous at x = 0. 

Longitudinal- Anomalous Sector.-The LA Sector corre- 
sponds to the (R+l) x (R + l) diagonal blocks along 
the diagonal. Labeling each block with an index k = 
0, . . . , R + 1, the matrix element in each block reads [35] : 



r^M? = A t (r)i% + \M2'8< i k \ r,8 = 0,. 
where Ag(r) is a shorthand for 
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k > r + 1. 

k < r + 1, 



,R (12) 
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(8) and 6. 
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k = 0,l,...,R + l, with 



Note that t = R+l if o = c or a = d or b = c or 6 = d. 
The Replicon geometry where a n b = c PI d = r, and 
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MT' S is the RFT of the matrix element M t r ' s with respect 
the cross-overlap t, that is, 

X>* r,s ( M P S (15) 

t=fc 

with , if r < s, 

( Pt t<r 
p\ r ' s) = I 2 Pt r<t<s (16) 
[ Ap t r < s <t 

If the scale k lies in the outer region then the RFT M^' s 
and Ar(r) become insensitive to the value of k, and the 
corresponding blocks are diagonalized through the eigen- 
value equation^] 

R 

XlaF = Ml£~, _ f r + - V M2L. 5 S f s (17) 

•' R+l;r+\ J 4 R+l ' 

s=0 

where S s = p a —p s +\. In the outer region the eigenvectors 
satisfy f ^ if T < x(Q r ) < T — > 0, and zero 

otherwise. Thus the eigenvalue equation becomes 

1 R 

A LA r = -M|g^^r, r = r,...,iJ. (18) 

s—r 

where r is the lower bound of the outer region, that is 
x(Qr) = I ~ ^ as T - s-0. The diagonal Rcplicon con- 
tribution vanishes for R — > oo, as ensured by the Ward- 
Takahashi identity, and does not contribute. This equa- 
tion has two distinct solutions. The first 

Ala = (19) 

for Ef=F^/ s = 0and 

^ = \ M R% 

= (x - ~ (3 2 (1 - q c (T)) 

= (a-l) + 0(T), T^O (20) 

for ^2^ = -8 s f s 7^ 0. The last equality follows from q c {T) = 
1 -qT 2 + 0(T 3 ) as T ->• with a = 1.575... [TB] - In the 
inner region, where the LA spectrum maintains the RSB 
structure, the solutions are smooth functions of the inner 
variable even for T — s- 0, while the width of the bound- 
ary layer vanishes in this limit. Therefore for T — > the 
eigenvalues (fT9"j) and (j2"0"|) cover the whole LA spectrum, 
with a discontinuity at x = 0. 

Conclusions. -To summarize, we have presented the 
analysis of the spectrum of the Hessian for the Parisi so- 
lution of the SK model in the limit T « 1. It has been 

2 The boundary term t = in the RFT is proportional to po = n 
and vanishes as n — y 0. The next term is proportional to p\ M^' B 
since Ml' s = 0, and vanishes for R oo. 



long known that in this regime two distinct regions can be 
identified according to the variation of the order parame- 
ter function Q(x) with x. The structure of the spectrum 
of the Hessian was, however, never studied. In this Note 
we have shown that the behavior of Q(x) for T < 1 has 
strong consequences on the eigenvalue spectrum. In the 
first region x < S ~ T, where Q{x) varies rapidly from 
Q(0) — up to Q{x) ~ q c (T) ~ 1, the spectrum maintains 
the complex structure found close to the critical temper- 
ature T c for the full RSB state. We then call this region 
the RSB-like regime. In the second region, T <C x < x c 
with x c ~ 0.575 . . . where Q{x) is slowly varying, how- 
ever, the eigenvalue spectrum has a completely different 
aspect. The bands observed in the RSB regime collapse 
and only two distinct eigenvalues are found: a null one 
and a positive one. This ensures that the Parisi solution 
of the SK model remains stable down to zero temperature. 
Massless propagators arise from Rcplicon geometry, with 
Ward-Takahashi identities protecting masslessness. Note, 
however, that the zero modes arise also from LA geometry, 
that is without protection of the Ward-Takahashi identi- 
ties. 

We observe that for T <C 1 the order parameter func- 
tion is almost constant for T <C x < x c , the variation 
being indeed of order [Q(x c ) - Q(x)]/Q(x) = O {(T/x) 2 ). 
Thus in this region we have a marginally stable (almost) 
replica symmetric solution, that becomes a genuine replica 
symmetric solution in the limit T — > 0, with self-averaging 
trivially restored. It is worth to remind that the stabil- 
ity analysis of the replica symmetric solution also leads to 
two eigenvalues, one of which is zero to the lowest order 
in T c — T (and negative to higher order), and the other 
positive. 

Recently Aspelmeier, Moore and Young have found 
that the interface free energy associated with the change 
from periodic to antiperiodic boundary conditions in finite 
dimensional spin glass does not follow the scaling form 
L e f(L/M), typical of a droplet scenario, if the state is 
described by a RSB scenario. Here 9 is the stiffness ex- 
ponent, L the length of the system along which the pe- 
riodic/antipcriodic boundary conditions arc applied, and 
M the length in the perpendicular directions. However 
the scaling form is obeyed if the state is described by a 
marginally stable replica symmetric solution. These re- 
sults were found using the truncated model, an approxi- 
mation of the SK model valid close to T c and used here to 
work with explicit solutions. The main conclusion should 
nevertheless be also valid for the full SK model [55] , imply- 
ing that, in the region T C i < i c the Replica Symmetric 
description prevails and the SK model is in a droplct-likc 
regime. 

Concerning the multiplicity of the eigenvalues we ob- 
serve that in each Sector, Replicon and LA, one has to sep- 
arate the contribution from the RSB-like and the droplet- 
like regions. The former is proportional to the width 5 of 
the region. Therefore in the limit T — > the contribution 
from the RSB-like region vanishes, and one has the usual 
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Replicon and LA multiplicities for the droplet-like region. 

Since in the limit T — > the domain of the RSB-likc 
regime shrinks to zero, and only the droplet-like regime 
survives, it can be viewed as a cross-over between the two 
scenarios. It is interesting to note that in the dynamical 
approach small values of x correspond to large time scales. 
As a consequence this implies that for T -c 1 the RSB sce- 
nario is seen on very very long time scales, while on shorter 
time scales a more droplet-like scenario is observed. 

We conclude by noticing that while these results 
strongly suggest a cross-over between RSB and droplet de- 
scriptions in spin glasses, to have a better understanding 
of the behavior of finite dimensional systems loop correc- 
tions to the mean-field propagators must be considered 
[27] . a task beyond the scope of this Note. 
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